arXiv:1507.08785vl [quant-ph] 31Jul2015 


Role of control constraints in quantum optimal control 

Dmitry V. Zhdano\0 and Tamar Seidemarjf] 

Department of Chemistry, Northwestern University, Evanston, IL 60208 USA 


Have you stopped drinking brandy in the 
mornings? Answer: Yes or No? 

Astrid Lindgren 

Karlsson-on-the-Roof is Sneaking Around Again 

The problems of optimizing the value of an arbitrary observable of the two-level system at both 
a fixed time and the shortest possible time is theoretically explored. Complete identification and 
classification along with comprehensive analysis of globally optimal control policies and traps (i.e. 
policies which are locally but not globally optimal) is presented. The central question addressed 
is whether the control landscape remains trap-free if control constraints of the inequality type are 
imposed. The answer is astonishingly controversial, namely, although formally it is always negative, 
in practice it is positive provided that the control time is fixed and chosen long enough. 
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I. INTRODUCTION 

Coherent control of the two level system is crucial 
for qubit design. The two-level Landau-Zener system is 
probably the most fundamental qubit model with the sin¬ 
gle control parameter u. Its master equation reads: 

p(t)=U t ,o{u)p(0)UI o {u), (1) 

with the unitary transformation U T "y{u) defined as 

Ut", r' (it)=exp(— i fJ =T ,(a x +u(T)a z )dT). Here p is the 
system’s density matrix, a x and a z are Pauli matrices, r 
is a dimensionless time r=at , and the control parameter 
is usually proportional to the interaction strength with 
an external controlled electric or magnetic field (u=/3£ 
or u=f3B). Depending on the physical meaning of the 
scaling factors a and /3, Eq. 0 can represent the wide 
variety of modern experiments on magnetic or optical 
control of quantum dots [I], vacancy centers in crystals 
[2], spin states of atoms and molecules [3], Bose-Einstein 
condensates 01 El, superconducting circuits [Bj etc. 

We consider the following optimal control problem: 

J= Tr[p(T)0]—» max (2) 

^max Cu^U m ax , (3) 

7<T max , (4) 

where max is taken with respect to the program (or con¬ 
trol policy) u(t ), and possibly also the final time T. This 
task well represents the initial preparation of the qubit in 
the given initial pure state corresponding to the largest 
eigenvalue of the observable O. 
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The key question of our study is the extent to which the 
restrictions ©• 0 complicate finding the policy w opt (r) 
which maximizes J[u] using the local search methods. 
The applied value of this question is justified both by 
technical limitations and also the breakdown of the two- 
level approximation in strong fields. In addition, the 
bound Q is motivated by the fatal losses of fidelity of 
quantum gates due to incontrollable decoherence at long 
times. 

The major obstacles in searching for u opt (r) are 
“traps” and “saddle points”. These are the special poli¬ 
cies u such that J[u(r)]<J opt and J[u+Su]<J[u] (trap) 
or J[u+Su]=J[u] (saddle point) for any infinitesimal vari¬ 
ation Su(t) consistent with (j3j. Presence of saddle points 
slows down the convergence of any local search strategy 
whereas reaching the trap leads to its failure. Traps and 
saddle points are controversial matters for optimal quan¬ 
tum control (OQC) theory. Despite substantial experi¬ 
mental evidence ESj supported by theoretical arguments 
of trap-free “quantum landscapes” J[u(r)] [81 IB} FTTI iT21 . 
it is also easy to provide simple counterexamples jl3lfl5] . 

The Landau-Zener system is quite special from this 
perspective since is the only system for which absence of 
traps in the unconstrained case (i.e. when u max =oo in 
([3])) was formally proven [7811191 . Moreover, its complete 
controllability for any finite value of u max (provided that 
T max is chosen sufficiently long) was also justified [201 
[22] . Thus, this system provides opportunity to evaluate 
the effect of constraints 0 and © on the landscape 
complexity in the most pristine form. The existing data 
portend that this effect should be nontrivial. For ex¬ 
ample, the unconstrained time-optimal policies u{r) are 
shown to be u(t)=c'5(t)+c"5(t—T) where c' and c" are 
constants and 6(t) is the Dirac delta function [27] . Such 
solutions are evidently inconsistent with any constraints 
of form ([3]). 

An additional feature of the Landau-Zener system is its 
simplicity, which allows us to infer analytically the topol- 
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ogy of J[u}. We hope that this exceptional opportunity 
will provide some clue on the expected outcomes in more 
complex cases, which can be handled only numerically. 

It is worth mentioning that the restrictions ^ are crit¬ 
ical in the foundation of modern theory of optimal con¬ 
trol since the corresponding problems can not be solved 
in the framework of classical calculus of variations and 
require special methods, such as the Pontryagin’s maxi¬ 
mum principle (PMP) [T6J[T7]. For completeness of the 
presentation, we provide in Sec. [XT] the brief overview of 
PMP and the known results of the first-order analysis of 
controlled Landau-Zener system in the PMP framework. 
In particular, we clarify why the unconstrained problem 
([2]) is trap-free, and introduce the primary classification 
of the stationary points (i.e. the locally and globally op¬ 
timal solutions, traps and saddle points) by showing that 
all of them in the case of time-optimal control as well as 
traps and saddle points in the case of fixed time con¬ 
trol are represented by piecewise-constant controls u(t ) 
which can take only 3 values: 0 and ±rt max . 


The rest of the paper is organized as follows. In Sec. Ill 


we derive the comprehensive set of criteria which allow 
to outline the landscape profile and distinguish between 
various types of its stationary points. The obtained cri¬ 
teria substantially extend, generalize and/or specialize 
a number of known results [25U26] obtained for related 
problems using the index theory [27] methods, optimal 
syntheses on 2-D manifolds [28], etc. In this work we pro¬ 
pose the technique of “sliding” variations which allows to 
reduce the high-order analysis to methodologically sim¬ 
ple and intuitively appealing geometrical arguments. 

In subsequent sections [W] and [V] we apply these crite¬ 
ria to identify and classify the traps and saddle points for 
the cases of time-optimal and time-fixed control, corre¬ 
spondingly. A brief summary of the obtained results and 
the general conclusions which follow from this analysis 
are given in the final section m 


II. REGULAR AND SINGULAR OPTIMAL 
POLICIES 

In this section we review the first-order analysis of 
problem 0 with constraint 0 in the PMP framework. 
For additional details one can refer to extensive literature 
(e.g. [ 12 ], pp.280-286,[25]). PMP provides the necessary 
criterion of local optimality of control ■u(r) in terms of the 
Hamilton-type Pontryagin function K{p{t),0{t) 1 u{t))\ 

u(t)= argmaxAT(p(r), O(r), u(r)). (5) 

u(t) 

The processes satisfying the PMP are called stationary 
points, or extremals, and will be denoted hereafter with 

the ~ marks: {u(t), p(t),0(t)}. 

The Pontryagin function among the state variables p 
and controls u depends also on the so called co-state of 
adjoint variables O(r), which are subject to the special 


evolution equation and boundary transversality condi¬ 
tions. In the case of the control problem [I] ([2]), the Pon¬ 
tryagin function takes the form: 

K(p{T),d(T),u(T))=-iTr |[p(r),d(r)](<j x -t-u(r)<j z )| , 

( 6 ) 


the evolution equation for O(t) coincides with 0: 


0[r")=U T " jT '(il)0{t')U].,, T ,{u), 


and the boundary conditions read, 


o{T)=d- 


K{T) 


=0 if T is unconstrained; 
>0 in the case Q. 


( 7 ) 

( 8 ) 
( 9 ) 


Since the Pontryagin function 0 linearly depends on 
u{t) the PMP can be satisfied in two ways, 

1) The switching function 

A'=-iTr|[p(r),0(r)]ij z | 7 ^ 0 . In this case 
u(T)=UmaxSign(g i |yy AT), and the corresponding 
section of the trajectory is called regular. It is clear 
that the optimal policy u{t) is actively constrained, 
and relaxing the inequalities (|3j) will improve the 
optimization result. For this reason, the optimal 
trajectory containing the regular sections can not 
be kinematically optimal. An optimal process 

{p(r), O(r), m(t)} for which u{t)= ± u max everywhere 
except for the finite number of time moments is often 
referred as the bang-bang control. 

2) It may happen that the switching function remains 
equal to zero over a finite interval of time. In this case, 
the corresponding segment of the trajectory is called 
singular, and the associated optimal control can be 
determined only from higher-order optimality criteria, 
such as the generalized Legendre-Clebsch conditions, 
Goh condition etc. HU [2111503 

Substituting ([I]) and Q into Q one can directly check 
that the Pontryagin function for problem 0 is constant 
along any extremal: 


Vr : K(t)=K>0 on each extremal, (10) 


where the strict inequality holds only if the constraint 
Q is active, and 

Vr : Jv(r)=0 for any kinematically optimal solution. 

( 11 ) 


A. Singular extremals of the problem 0 

Every kinematically optimal solution u{t ) consist of a 
single singular subarc. Here we show that in the case of 
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the Landau-Zener system the converse is also true: ev¬ 
ery singular extremal u(r) corresponding to inactive con¬ 
straint 0 delivers the global kinematic extremum (max¬ 
imum or minimum) to the problem 0- Indeed, let n 
be an arbitrary internal point of the singular trajectory. 
Then, the PMP states that: 


d 


du(r) 


K(r)=—i Tr j [p(r i), 0(ri)]17^ ri (u)a z U TiTl (u)| =0 

( 12 ) 


for any r such that |r — ri|<e and sufficiently small e, 
and in particular: 

-iTr |[p(ri),0(ri)]o- z | =0. (13a) 


The two subsequent time derivatives of the equality (12) 
at t=t 1 give, 

-* Tr | \p(n), 6 (ri)]o-j,| =0 (13b) 

-m(ri)Tr|[p(ri),6(ri)]iT x | =0. (13c) 


Equations (13) can be simultaneously satisfied only in 


the two cases: 

[p(t),O(t)]= 0; (14a) 

[p(r), 0(r)]=iKa x and u(t)=0 (k= const ^0). (14b) 


The condition (14a) is nothing but the criterion of the 


global kinematic extremum (maximum or minimum) for 
our two-level system. In other words, we just proved 
that all the extrema of the landscape J(it) for the un¬ 
constrained Landau-Zener system except for the case of 
u(t)=0 are its global kinematic maxima and minima. 
This result was obtained in mm- 

The condition (14b) indicates that the only possible ev¬ 


erywhere singular non-kinematic extremal of the problem 
gisu(r)=0 (t€[0, T}). Eq © implies that K(t)=k in 
this case. Thus, in view of & this extremal can appear 
only under the active pressure of the constraint 0. 

B. Regular and mixed extremals of the problem ([T]) 


According to the PMP and conditions (14), the generic 


non-singular extremal is the piecewise-constant func¬ 
tion with n switchings of either bang (n=±it max ) or 
bang-si ngula r (w=±u max , 0) type where the singular arcs 
match (14b). For convenience, we will refer to extermals 


with (without) singular arcs as of type II (type I). We 
will use the subscript i (i.e. fj, pi etc., 0<?<n+l) for 
the parameters related to the i-th control discontinuity 
(corner point). The durations of the right (left) adjacent 
arcs and the associated values of u will be labeled as At* 
(Ari_i) and uf (u~). The subscripts i— 0 and i=n+ 1 
will be reserved for the parameters of the trajectory end¬ 
points. We will also sometimes use the notations S I and 


S II with index s denoting the number of times the control 
changes the sign. 

We first address the properties of type I extremals. 
The necessary condition of the i-th corner point is given 
by eq. (13a). Combining it with (10) we get, 


-i[p(Ti),0(fi)]=c itl a x +Ci,2(Ty, c^ijCj^eR, (15) 

where Ci i i=0(>0) when the constraint 0 is inac- 
tive(active) and the case Cj,i<0 can result from the op¬ 
timization with fixed T. Consider the adjacent (i+l)-th 
bang arc. The PMP criterion ([5]) for its interior reads, 

u(t) |r>fi = arg max Tr [U Ttfi {cipa x +Ci^y)U^. a z \u, 

(16) 

which gives uf=-^f ? TU max . If the (i+l)-th arc ends with 


another corner point f t +\ then it follows from (16) that, 
^[Uf i+ x,fi{cip^x+Ci,2cry)U^ lfi a z \=Q. (17) 

Condition © can be reduced to the form, 

Ci,2-v / w^ ax +l=-Ci,iu+ tanfAriv^uLx+l), ( 18 ) 

and resolved relative to Arj+i. Retaining the physically 
appropriate solutions consistent with eq. (16) we obtain, 


a~ ) St c *,i< 0 ; 

Ar^+i— < . . - (19) 

I 7rcos(a)— OTi, Ci t i>0, 


where a= arctan(u max ) and 


5r,-=arctan 


C2,i 


Cl ,i't/max 


Note that -i\p{f i+1 ), d(f i+ 1 )\=c 1 A a x -c it 2 cry, be. 


Cl,i, C2,i+1 —— C2,i 


sec(a) I cos(a). (20) 


( 21 ) 


Since eqs. © and ( [20| do not depend on the sign of 
one obtains that durations of all interior bang segments 
are equal: V*> 2 ,i<n : Arj=Ar (see Fig.g). Moreover, 
eq. (19) admits the estimate \ cos a< At<tt cos a for the 
case of time-optimal problem with constraint Q. 

Consider now the extremals of type II. L et rg (f,-_i, f,-) 
be the singular arc where the relations (14b) hold. If 


fj^T when it is the corner point between regular and 
singular arc. Suppose that there exists one more cor¬ 
ner point Tj + i>Tj. Then it follows from eqs. (21) (19) 
and (|17|) that Ar 1 =7rcosa and 17? +1 ,■?-=—/, so that 


P(fj+ o]= p{Tj). Using similar arguments, it is straight¬ 
forward to derive the analogous result for possible cor¬ 
ner points prior to t :] . Thus, taking any 3-segment “an- 
zatz” extremal similar to that shown in Fig. [lb, one can 
construct an infinite family (■u(t)) of lbW ex t r emals 
(k=fc 1; fc 2 ) by randomly inserting Aq and /C 2 bang seg¬ 
ments of the length 7r cos a with u=+u m ax and u=—u m ax 
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FIG. 1. Possible types of extremals u(t) associated with nonk- 
inematic optimal solutions and traps as well as the locally 
time-optimal kinematic optimal solutions. 


into corner points of u(t) or inside its singular arcs. It 
is clear that each family ^^(^(r)) constitutes the con¬ 
nected set of solutions, and all the members have equal 
performances J. Thus, the properties of any type II ex¬ 
tremal can be reduced to the analysis of the equivalent 
three-segment °II type or Hi type extremal where all the 
positive and negative bang segments are merged into dis¬ 
tinct continuous arcs separated by a singular arc. 

The presented first-order analysis outlines the admis¬ 
sible profiles for optimal non-kinematic solutions (see 
Fig. 0 - Moreover, by continuity argument (i.e. by con¬ 
sidering the series of solutions with fixed T—>T opt from 
below), these profiles should embrace all possible types of 
the stationary points of the time-optimal problem §>,<§• 
It is worth stressing that the later include the globally 
optimal and everywhere singular kinematic solutions for 
which both segments with u= ± u max and u=0 are sin¬ 
gular. With this in mind, it is helpful to introduce the 
following terminological convention for the rest of the pa¬ 
per in order to preserve the integrity of the presentation 
while avoiding potential confusions: we will reserve the 
term “singular” exclusively for the segments of extremals 
at which u=0 whereas the segments with u= ± u max will 
be always referred to as “bang” ones. 

The reviewed results have several serious limitations. 
First, they do not allow to distinguish the globally time- 
optimal solution from the trap or saddle point. Sec¬ 
ond, they do not provide detailed a priori knowledge 
of the characteristic structural features of these station¬ 
ary points (e.g. the expected type, number of switchings 
etc.) which is necessary to determine the topology of the 
landscape J[u]. These tasks require higher-order analy¬ 
sis, which is the subject of the next section. 


III. DETAILED CHARACTERIZATION OF THE 
STATIONARY POINTS 


In this section we will extensively use the geometrical 
arguments in our reasoning. To make the presentation 
more visual, it is useful to expand the states and observ¬ 
ables in the basis of Pauli matrices and identity matrix /: 


P~h I+ ^i=. 


i=x,y,z 


0 =iTr[0]/+£ i= , 


i=x,y,z 


OiG{. 


The 




a) b ) 


FIG. 2. (a) The case rjr£>0: Equatorial singular arc 

r~ —>r + (thick black line) is more time-effective than bang- 
bang extremal r~ —>r'—>r + (thick orange line). The ex¬ 
tremal r~ —>r" —»' + (thin blue curve) represents local ex¬ 
tremum (trap), (b) The case r~r+< 0: Equatorial singular 
arc r~ —(thick orange line) is the suboptimal relative to 
the bang-singular extremal r~ —¥r'—.>r + (thin black line). 


dynamics induced by eq. 0 corresponds to the rota¬ 
tion of the 3-dimensional Bloch vector r = {r x ,r y ,r z } 
around the axis n u oc{l, 0, u} (note that the angle be¬ 
tween u±u max and n 0 is equal to a, see e.g. Fig. [2]), and 
the optimization goal ([2]) is equivalent to the requirement 
to arrange the state vector r in parallel to o. In what fol¬ 
lows we will often refer to the quantum states p as the 
endpoints r of vectors r. Hereafter we will also assume 
that both r and o are renormalized (scaled) such that 

M=M=i- 

We start by taking a closer look at type II extremals 
and their singular arc(s) where u(r)= 0. According to cri¬ 
terion (14b), these arcs are always located in the equato¬ 
rial plane x=0. The following proposition indicates that 
such arcs may represent the time-optimal solution at any 
values of u max (see Appendix [A| for proof): 


Proposition 1 . The shortest type II singular trajectory 
connecting any two “equatorial” points r~ ={0,r“,rj} 
and r f ={0,r+,r+} (see Fig. [^) will represent the (glob¬ 
ally) time-optimal solution if r“r+>0, (r+—rj)r“>0 
and the saddle point otherwise. 


Since all S II extremals can be reduced to the effec¬ 
tive 3-section anzatz (see the end of the previous section) 
Proposition [l] has the evident corollary: 

Proposition 2. All singular arcs of the locally optimal 
type II extremals are located in the same semi-space y >0 
or y< 0, and their total duration can not exceed 7r/2. 

For further analysis we need the following generic nec¬ 
essary condition of the time optimality: 

Proposition 3. If the type I extremal {u(r),f(r)} is 
locally time-optimal then each of its corner points fi sat¬ 
isfies the inequality: 


Ui fi,xh,y> 0. 


( 22 ) 
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FIG. 3. The globally time-optimal °II type trajectory u a nz{r) 
(thick bright yellow curve) and the locally time-optimal trap¬ 
ping solution (black curve) of the X® (w anz (r)) family con¬ 
necting the points rooc{l, 1 , — 1 } and ooc{— 1 , 1 , 1 }. 


Qualitatively, Proposition [3] states that the projections 
of optimal trajectories on the ccz-plane are always ”V”- 
shaped at the corner points f,; with fi X >0 and ”A”- 
shaped otherwise (here we assume that the x-axis is ori¬ 
ented vertically, like in Fig. [2]). 

Proposition © allows to substantially narrow down 
the range of the type II candidate trajectories: 


Proposition 4. Any type S II extremal with s>0 contain¬ 
ing the interior bang arc of duration At> 7 t sec a is the 
saddle point for the time-optimal control. 


In other words, all the type S II| s >o locally time-optimal 
solutions reduce to the 3-piece anzatz shown in Fig. 
where two regular arcs of duration Ar 0 , Ar 2 < 7 rseca 
“wrap” the singular section where u=0. Accordingly, the 
number of control switchings is bounded by nn< 2 . 

The properties of the °II type extremals are richer: 


Proposition 5. Suppose that the 0 II type extremal u(r) 
is the member of family (w anz (r)), and its anzatz 
«an z (r) has nonzero durations Atq and Ar 2 of opening 
and closing bang segments. Then u(r) is locally optimal 
iifu anz (T) is locally optimal 


(for proof see Appendix [d|) . 

The analysis of type I extremals is somewhat more 
complicated. We begin by determining the loci of corner 
points fi on the Bloch sphere. Denote as 9=2 At sec a 
the rotation angles on the Bloch sphere associated with 
the inner bang sections of the type I extremals. Note 
that it follows from (19), (20) that tt<9<2tt in the case 
of time-optimal control problem. 


Proposition 6. All the corner points fi of any locally 
optimal type I solution u(t) of problem ©, © are lo¬ 
cated on the circular intersections of the Bloch sphere 
with the two planes A±i (see Fig. |^p; 

fi={sign(u+) sin( 7 i) sin(^), - sin( 7 ^ cos(|), cos^)} 

(23) 



^Mmax 


X 


FIG. 4. Illustration of the statement of Proposition [ 6 ] The 
thick colored curve depicts the band-bang extremal. Its red 
and blue segments correspond to u= max and u=— max. All 
interior corner points (red and blue balls) lie on two circles (as¬ 
sociated with Switchings Umax ^ u max and 1 /■,,i a x ^ U in ri.x • 
correspondingly) whode planes A±i intersect along the z-axis. 


Here £=—2 arctan ( Un ^ x tan(|) cos(a)) is the dihedral 
angle between the planes A±i, and 7 ,+ 1=71 +ir], where 

sm(§) 


ri =—2 arctan 


V“max+ C ° s 2 (f) 


Proposition 7. Denote q i =q('y i )= cot 2 ( 7 j)— cot 2 (|) 
(*=1,..., n). The set {q.j} associated with any locally time- 
optimal extremal u(t) contains at most one negative entry 
Q 1 , and |g , | = min(|{g i }|). 


The proofs of the above two propositions are given in 
Appendix [E] 

To use Proposition [7] it is convenient to introduce the 
parameters Q through, Ci = 7i+f (1 — sign(u) 1 " )), Q+i = 
Ci+*( 7 r+» 7 ). It is evident that q(”fi)=q(Ci)■ The relation 
between the sign of qi and the index i of the corner point 
can be illustrated by associating each qi with the point on 
the unit cycle whose position is specified by Q, as shown 
in Fig. [5} One can see that the maximal number n max 
of sequential parameters qi having at most one negative 
term can not exceed 7r+ | T? ! + 1 <~, i.e., 

Proposition 8. Type I locally optimal extremals can 
have at most — switchinqs. 

This helpful upper bound was first obtained by Agrachev 
and Gamkrelidze [2B] ■ As shown in Appendix [Fj we can 
further refine this result via more detailed inspection of 
the criterion \q'\= min(|{gj}|): 

Proposition 9. «i imax <2 if M max >V / 1+V% 

(The latter roughly corresponds to a>l). 

The analysis in this section so far is equally valid for 
both global and local extrema (traps) of optimal control. 
It is clear that any globally time-optimal type II solution 
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FIG. 5. Signs of parameters q(() as function of £. Black dots 
indicate the values C = Ci associated with i-th corner point. 

includes at most 2 corner points that separate the cen¬ 
tral singular section from the outside regular arcs (see 
Fig#)- The case of type I solutions is not as evident. 
The following propositions impose more stringent neces¬ 
sary criteria on the globally time-optimal extremals (see 
Appendices [G] and [H] for proofs). 


Proposition 10. Any corner point rV such that <?( 7 i ')<0 
must be either the first or the last corner point of the 
globally time optimal solution, so that the total number 
of switchings ni, ma x<^+l- 

Proposition 11. The corner points f'i of any globally 
optimal solution of type I satisfy the inequality: 

min(0, r 0 . x , r n+1 , x )<r i:X < max(0, r 0jX , f n+liX ), (24) 

where fo, x and f n +i iX are the trajectory endpoints. 

Proposition El can be used to establish the following 
more accurate upper bound on the number of switchings 
(see Appendix [I] for proof). 

Proposition 12. The number of corner points of the 
globally time-optimal type I solution u(r) is bounded by 
the following inequalities: 


[left 


n\< {] max( 


arccos(i) n 

I x 

2 arctan( Ul ^ x )|’ |2 arctan( ttrn ^ x )| 


arccos(?nr) 

min(^- , ,;i. +3 


2 arctan( ) | |4arctan( Mrn j lx )| 


)+l ifr x r+<0; 


)+l if f x f+>0, 


(25a) 

(25b) 


where r + and f are new notations for the trajectory 
endpoints fo and f n + such that |r+|>|f“|. 

Let us denote (f>^= |0 rOj ^— 0 o (£ = x,z ), where 6 r ^ is 
the angle between the axes ej and r. One can geomet¬ 
rically show that the maximal possible change Ad( n | ,x in 
9 r ^ generated by rotation around any of the axes n ± Umax 
is A(9“ ax =2a and A(9“ ax =7r-2a (see Fig# This fact 
allows us to establish the following lower bounds on the 
number of corner points: 


Proposition 13. The minimal number of corner points 
in locally time-optimal solutions reaching the global max¬ 
imum of J is bounded by the inequalities: 


| arcsin(r 0 a;) — arcsin(o x )| 
n> --- 7 -r- 1 ; 

2 arctan^-Umax) 

| arcsin(r 0 2 ) — arcsin(o 2 )| 

rii> -—---- 1 

2 arccot(u max ) 


(26a) 

(26b) 



FIG. 6. Geometrical calculation of the value of Ad’fjf . Rota¬ 
tion 5n_„ max around vector n_ umax transfers any point r, on 
Bloch sphere into new point in AA' plane. The ^-coordinate 
of this new point is bounded by planes and A". Thus, the 
associated change in 9 TiX is less than ZAOB=2a. 


Proposition 14. The globally time-optimal solution(s) 
of problem ([ 2 ]) is of type I if 


It is worth stressing that the bound (26b) is valid only 
for type I solutions. 

Combination of the upper bounds on n imposed by 
Propositions |4] and 10 with inequalities (26) leads to the 
following conclusion: 


cf> x = |arcsin(r 0 a; )— arcsin(o x )| >4a (27a) 

and of type II if 


f> z = |arcsin(ro i2 )— arcsin(o 2 )| > 


2a 


+2 


( 7 r- 2 a). (27b) 
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FIG. 7. Distribution of types of globally optimal solutions 
according to Proposition [14] Note that the admissible values 
of (j> x and 4> z are restricted by inequality (f)x+<t>z<Tr. 


Note that this estimate can be further detailed if com¬ 
bined with the refined upper bounds stated in Propo¬ 
sition [l2j The statement of Proposition [14] is graphi¬ 
cally illustrated in Fig. [7] which clearly shows that the 
type I and type II solutions are dominant in the opposite 
limits of tight and loose control restriction it ma x~tO and 
Umax— too, correspondingly. Neither type, however, to¬ 
tally suppresses the other one at any finite positive value 
of u m ax- This coexistence sets the origin for the generic 
structure of suboptimal solutions (traps), whose analysis 
will be the subject of next two sections. 


IV. TRAPS IN TIME-OPTIMAL CONTROL 

The globally time-optimal solution (hereafter denoted 
as u opt ) of the problem © can be supplemented by a 
number of trapping suboptimal solutions u (character¬ 
ized by J<J opt and/or T>T ,opt ) which are however op¬ 
timal with respect to any infinitesimal variation of u(t) 
and T. In particular, Proposition © implies that each 
locally optimal solution of type °II gives rise to the in¬ 
finite family of traps of the form shown in Fig. [3j In 
what follows, we will call such traps as ’’perfect loops”. 
Proposition [l] indicates that the perfect loops may ex¬ 
ist at any value of u max . Nevertheless, their presence 
does not stipulate sufficient additional complications in 
finding the globally optimal solution by gradient search 
methods. Indeed, these “simple” traps can be identified 
at no cost by the presence of the continuous bang arc 
of the duration Ari>7r sec(a). Moreover, one can easily 
escape any such trap by inverting the sign of the control 
u(r) at any continuous subsegment of this arc of dura¬ 
tion 7rsec(a) or by removing the respective time interval 
from the control policy. 

For this reason, the primary objective of this section 
is to investigate the other, “less simple” types of traps 
which can be represented by type I and s II| s >o subopti¬ 
mal extremals. Propositions [8] |To[ |T2j and |i~3| show that 
the number of switchings n in such extremals is always 
bounded (at least by ir/a). Thus, the maximal number 
of such traps is also finite and decreases with increasing 
Umax- It will be convenient to loosely classify the traps 
into the “deadlock”, “loop” and “topological” ones as 



FIG. 8. Globally optimal solution (blue line), deadlock traps 
(light-red and green lines) and loop trap (black line) for 
the time-optimal control problem ©•©•© with "Umax —\i 
r (°) = { 72 ’ 75’°}’ (big emerald dot) and o={^,-^=, 0} (big 
black-yellow dot). Small dots indicate the positions of corner 
points. The parameters of extremals are listed in the table: 


extremal 

sign(% ) 

n 

An 

At 

At n+1 

red 

+ 

0 

0.23 

- 

- 

green 

- 

2 

0.88 

1.52 

0.88 

blue 

+ 

4 

0.33 

1.78 

0.33 

black 

- 

5 

1.15 

1.72 

0.57 


follows. The first two kinds of traps are represented by 
type I extremals. The deadlock traps are defined by in¬ 
equalities J<J opt T<T ° pt . They usually also satisfy the 
inequalities n<n opt . Their existence is mainly related to 
the fact that the distance to the destination point o for 
most of extremals non-monotonically changes with time. 
The trajectory of the loop trap has the intersection with 
itself other than the perfect loop. These solutions require 
longer times T>T opt and typically also larger numbers 
of switchings n>n opt in order to reach the kinematic ex¬ 
tremum J=J opt . Finally, the topological traps are asso¬ 
ciated with extremals of the type distinct from the type 
of the globally optimal solution. Of course, real traps can 
combine the features of all these three kinds. 

Examples of the deadlock and loop traps are shown 
in Fig [s} In this case the globally time optimal solution 
with n opt =4 is accompanied by two deadlock traps and 
two degenerate loop traps corresponding to n =5 (only 
one is shown; the remaining solution can be obtained via 
subsequent reflections of the black trajectory relative to 
the yz and zy-planes). At the same time, no traps exist 
for n= 1, 3 and n> 5. 

The bang-bang extremal r~—>r" —>r + (blue curve) in 
Fig# provides another example of the loop trap that is 
also the topological trap relative to type II optimal tra¬ 
jectory r“->r + (the specific parameters used in this ex¬ 
ample are: u ma x=|, r“=r 0 oc{0,1, -|}, r+=ooc{0,1,1}). 
In general, once the endpoints and r + satisfy the 
conditions of Proposition [l] the time-optimal solution 
remains the same type II trajectory even in the limit 
Umax—^0, where the most time optimal trajectories are 
of type I (see Proposition 14 and Fig. [7|. Moreover 
the traps of the shown form will exist for any value of 



















FIG. 9. The optimal solution (medium-thick trajec¬ 
tory ro—>ri— >rn—>o), topological trap (thin trajectory 
ro— >r~ — >r + —»o) and deadlock trap (thick trajectory ro— >r') 
for the time-optimal control problem with Umax—8, 

r(0)cx{|, |,Mmax}, ooc{l, 0, Umax}- The segments colored 
blue\black\red correspond to m(t)=— u max \0\-|-M m a X and are 
associated with rotations about the axes n_ umax \e' ;c \ra-, lm a X - 
The durations A n of the consequent bang arcs are summa¬ 
rized in the table:_ 


extremal 

type 

n 

Ar 1 

A r 2 

At 3 

deadlock trap 

I 

0 

0.020 

- 

- 

optimal solution 

I 

2 

0.0327 

0.262 

0.017 

topological trap 

II 

2 

0.075 

0.031 

0.324 


■Umax<i/4-(r- +rt) 2 /\r z -r+|. 

Another generic example of the traps of all three types 
can be straightforwardly constructed in the case « ma x>l 
(see Fig. [9]) by selecting oocjl, 0, u max } and choosing the 
initial state in vicinity of z= 1: r 0 oc{ci, C2, w max }, where 
0<Ci<l and C 2 is any sufficiently small number. Al¬ 
though the vast majority of time-optimal solutions are 
of type II in the limit u max —too (see Proposition [14]), for 
this special choice the optimal solution is of type I for 
any finite value of M max whereas the complementary type 
II extremal represents the topological trap. In the case 
C2<0, there also exist a deadlock trap structurally similar 
to the ones shown in Fig. [8] 

These observations lead to the following key proposi¬ 
tion: 


Proposition 15. For any value of u max there exist ini¬ 
tial states po, observables O and locally time-optimal con¬ 
trol policy u(t ) whose constitutes the non-simple traps of 
time optimal control problem (§■(§> @ 


V. TRAPS IN THE FIXED-TIME OPTIMAL 
CONTROL 


Consider the problem © 

T is fixed. Specifically, we wil 


(3j where the control time 
be interested in the case 


T =const — 
a 


(28) 


when the kinematically optimal solutions exist for any 
given p 0 and O. We again will exclude the class of perfect 
loop traps from the analysis for the same reasons as in 
the previous section. Intuitively one can expect that the 
probability of trapping in the local extrema (other than 
perfect loops) should be small at large T. However, it is 
not clear if there exists such value of T that the functional 
([2]) will become completely free of such traps. 

To answer this question, note that in line with the anal¬ 
ysis given in Sec. [n] any trap should be represented by 
either type I or type II extremal. However, the maximal 
number of switchings is no longer limited by inequalities 
similar to Proposition [8] At the same time, Proposition [6] 
remains applicable (see Remark 1 in Appendix[E]). Recall 
that its proof is based on introduction of the “sliding” 
variations <$7* which shift the angular positions of the 
“images” of corner points on the diagram of Fig. [5 (see 
Appendix [E| . The explicit expression for the “sliding” 
variation around the i-th corner point up to the third 
order in the associated control time change is given 
by eq. (E4). By definition, if the trajectory u(r) is type I 


trap, then no admissible control variation Su can improve 
the performance index ([2]). Consider the subset H of such 
variations composed of infinitesimal sliding variations 8"fi 
that preserve the total control time T. Then, the neces¬ 
sary condition of trap u(t) is absence of the non-uniform 
sliding variation Su(r)Gfl that leaves the trajectory end¬ 
point r n+ 1 intact. Indeed, the trajectory associated with 
varied control u+Su would deliver the same value of the 
performance index but at the same time is not the lo¬ 
cally optimal solution (since it is no longer the type I 
extremal) which implies that u is not locally optimal. 

Using (E4) the stated necessary condition can be 


rewritten as the requirement of definite signature of the 
quadratic form (E6), where the parameters qi were in¬ 
troduced in Proposition ([7|. The necessary condition of 
the sign definiteness is that all (probably except one) pa¬ 
rameters qi are either non-positive or non-negative. Us¬ 
ing Fig. one can see that in the case of long T only 
the second option can be realized with 0, 7—— f and 
—| (the case 7r must be eliminated because it im¬ 
plies u max=0). One can show that the last two variants 
lead to saddle points rather that to the local extrema. 
The remaining case rj~0 leaves the two options 0~O and 
0~27 t. The last option corresponds to positive constant 
Cj,i hr |l5| ), which indicates the possibility of increasing 
J via monotonic “stretching” the time: T^T+ST(T), 
u(t)—>u(t—8T(t)), where 8T(t) is an infinitesimal posi¬ 
tive monotonically increasing function. At the same time, 
the associated parameters qi are all negative, so there ex- 
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ists the combination of variations St of arcs durations At 
which will result in achieving the same value of the per¬ 
formance index at shorter time. Thus, we can conclude 
that it is also possible to increase J at fixed time T via 
proper combination of these two variations, so the vari¬ 
ant 0~27 t should be dismissed as a saddle point. Only 
the remaining choice 0 is consistent with an arbitrary 
number of qi of the same sign. However, in this case 
the length of each bang arc also reduces to zero. As re¬ 
sult, the maximal duration of such optimal trajectories 
is limited by the inequality T< tt. 

This analysis leads us to remarkable conclusion: 

Proposition 16. The fixed-time optimal control problem 
© is free of non-simple traps for sufficiently long control 
times T. 

The spirit of this conclusion is in line with the results 
of numerical simulations performed in m- With this, 
it is worth recalling that the general time-fixed problem 
may have a variety of perfect loop traps for any value of 
Umax and, thus, is not trap-free in the strict sense. These 
traps were missed in the simulations in m due to the 
specifics of numerical optimization procedure. 


VI. SUMMARY AND CONCLUSION 


All stationary points of the time optimal control prob¬ 
lem and all saddles and local extrema of the fixed-time 
optimal control problem are represented by the piecewise- 
constant controls of types I and II sketched in Fig. [l] (the 
associated characteristic trajectories p(r) on the Bloch 
sphere are shown in Figs. [4] and [3j correspondingly). 
We systematically explored the anatomy of stationary 
points of each type. Specifically, we identified the loca¬ 
tions and relative arrangements of corner points on the 
Bloch sphere (propositions i i © 0 EJJ PH) a nd esti¬ 


mated their total number (propositions Tsf 9 10 12 


These characteristics together with propositions III 


131. 


and 14 allow to determine whether the given extremal 
is a saddle point or locally optimal solution, and also to 
predict the shape of globally optimal solution. The pre¬ 
sented results (except Proposition substantially gener¬ 
alize and refine the estimates obtained in previous studies 
[23j |55j. Moreover, this study, to our knowledge, is the 
first example of a systematic analytic exploration of the 
overall topology of the quantum landscape J[u] in the 
presence of constraints on the control u and for the ar¬ 
bitrary initial quantum state p 0 and observable O. In 
particular, we distinguished 4 categories of traps tenta¬ 
tively called deadlock, topological, loop and perfect loop 
traps. The landscape can contain an infinite number of 
perfect loops whereas the number of traps of other types 
is always finite. Among them the number of deadlock 
traps and loops decreases with increasing value of the 
constraint w max in eq. © Nevertheless, we have shown 
by an explicit example that the traps of all categories 
can simultaneously complicate the landscape J[u] of the 


time-optimal control problem regardless of the value of 
Umax- So, this is the case where the intuitive attempt 
to “extrapolate” the conclusions based on analysis of the 
case of unconstrained controls totally fails. 

The fixed-time control problem is more intriguing. On 
one hand we formally showed that it is impossible to 
completely “flatten” all the traps in this case by increas¬ 
ing the value of u m ax - This result is in line with generic 
experience concerning the optimal control in technical 
applications. However, if the control time is long enough 
(specifically, if T^>7r 2 /arctanu max ) the only traps which 
can survive are perfect loops. These traps can be easily 
escaped via simple modification of any gradient search 
algorithm at virtually no computational cost. Thus, the 
quantum landscape appears as trap-free from practical 
perspective, which supports the common viewpoint in 
quantum optimal control community. Since the con¬ 
trolled two-level system is the benchmark for quantum 
information processing this finding is relevant for efficient 
optimal control synthesis in a variety of experiments on 
cold atoms, Bose-Einstein condensates, superconducting 
qubits etc. 

The key methodological feature of the presented 
derivations is introduction of the sliding variations which 
makes it possible to extensively rely on highly visual and 
intuitive geometrical arguments. For this reason, we be¬ 
lieve that the mathematical aspect of the paper consti¬ 
tutes instructive introduction into high-order analysis of 
optimal processes. 


Appendix A: Proof of Proposition [l] 


Here we consider the case r“,r+>0. The case 
r-,r+<0 can be treated similarly. Simple geometri¬ 
cal analysis leads to the following expression for the 
travel time difference ST between bang-bang (orange) 
and “equatorial” (black) trajectories shown in Fig. 


AT a = cos(cn) ^arcsin 
cos(a)r+ 


arcsin( 

s_ 

arcsin( 2 


( 4f sec(a) — cos(a)r+ 

\J 1— sin 2 (a)rj 2 

. . . cos (a)rZ 

)—arcsm( 


=)+ 


1— sin 2 (a)ri" 
sec(a)+ cos(a)r; 


\]l — sin 2 (a)r 0 ' 


\J 1— sin 2 (a)ri 

-) ] — arcsin(rj")+ arcsin(rj), 

(Al) 


where S z =r~f — r z . Let us fix one of the endpoints r ± and 
vary the position of another one. Note that AT a |,5 z= o=0 

























10 


for any admissible value of r~. Furthermore, 


, d5T a 
drt 



rfS* 


~±v' 


-\ 1 - 


r* S z -\- sec 2 a 


~±Z~ 


->o. 


1 i r i 2 ^2 _ 

l-r 2 o 2 -r 2 — -r sec z < 


(A2) 


This allows to conclude that (5TT a >0 for any <5 2 >0 which 
finishes the proof of Proposition for the case ?'“7'+>0. 

Consider now the case r,“r+<0. For clarity, we will 
assume that r~ >0 r~ <rf (see Fig. 2b). The remain¬ 
ing cases can be analyzed similarly. The time difference 
<5Tb between “equatorial” (black) and the green trajecto¬ 
ries and its derivative with respect to the position of the 
endpoint read: 



FIG. 10. Projections of the characteristic pieces of the origi¬ 
nal, varied and reduced trajectories r(r), r , (r) and r"(r) on 
the xz plane (it is assumed that y-components of all shown 
parts of trajectories are greater than zero). The color associ¬ 
ations are indicated in the inset. 


(5Tb= arccos(r+)— cos(a) arccos 


' cos(a) 


T — rt sin 2 (a). 


(A3) 


d 2\Jl-rt 2 sin 2 (a) 

_1_ 0 -l\ 3— o o 

d r z rt cos(2 a)—rt +2 


(A4) 


These expressions show that <57b| 


= 0 and that 


i5Tb>0 for any admissible value of r+. Thus, <5Tb>0 
which proofs Proposition for the case r~ r+ <0. 


Appendix B: Proof of Proposition [3] 


Appendix C: Proof of Proposition |4| 


Consider any type S II extremal with s>0. By defi¬ 
nition, such extremals must contain at least one inte¬ 
rior bang segment rs[fj,of length Arj=m7r cos(ct) 
(to € N, 0<fj,fi+i<T). Since both the value of 

the performance index J and duration T will not change 
if this segment will be “translated” in arbitrary new point 
r(r- {k)) of extremal via the following continuous varia¬ 
tion u(t)—>u(k,t) (— Ti<K<T— to 7 t cos a): 


u(k , t)= 


n(r), 

n(r-Arj) 


, ~ , k—\k\ w . ~ , k+\k\ 

T<Ti -)- f- 1 V T > T i+l + ~2~ L 'i 

Ti+K<T<T i+ i+K\ 

otherwise, 

(Cl) 


The proof is based on explicit construction of the 
second-order McShane’s (needle) variation of the control 


u(t) which decreases T if the inequality (221 is violated. 
Choose arbitrary infinitesimal parameter 5t~— >0 and de¬ 
note r~=r(fi—5T~). Under assumptions of Proposition 
it is always possible (except for the trivial case f'i iy =0) to 
choose another small parameter St + such that the state 
vector rf=f(fi+8T + ) obeys the equality: r~ x =rt x ■ It is 
evident that the Bloch vector r~ x can also reach rf x in 
the course of free evolution with u=0 after certain time 
St°. If we require that (5 t+, (5r( 1 | (5T -_ y0 =0 then both r+ 

and rf are uniquely defined by St\ \ 


St + = St z (G,y+ 2 ^ G,z) 


+ o(St z 2 ); 




St°= 2STi ^ 


(Bl) 


and thus, St^—St + ~St~=2u~(St^) fi iX /fi tV . The lat¬ 
ter quantity should be nonnegative for the locally time- 
optimal solution which leads to eq. (22). 


where T\K)=fi+K+\{l+^)/±.Ti. 

Suppose that u(t) is locally time-optimal solution. 
Then all the family of control policies {u(n, r), r(n, r)} 
should be locally time-optimal too. Since s>0 it is always 
possible to select the value k=kq such that r(r'(n o)) is 
interior point of the bang arc with u(t'(ko))=— uf and 
o))y^0. However, the resulting trajectory t(ko,t) 
is both A- and U-shaped in the neighborhood of point 
r(fi+Ko)=r(fi + i+Ko). According to Proposition ([3]) such 
trajectory can not be time-optimal. The obtained con¬ 
tradiction finishes the proof. 


Appendix D: Proof of Proposition [5] 

Let u'(t) be the control strategy obtained via arbitrary 
McShane variation 5u(t) of the control u(t). Let us show 
that u'(t) is less time efficient than some member u"(t) 
of the control family (w ,,anz (r)) with the same k but 
perhaps the different anzatz u" . For this we will need 
the following lemma which is complementary to Propo¬ 
sitions m an d S 
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Lemma 1. Suppose that r' (r / ) is junction point of two 
bang arcs of the trajectory u{t ) such that r x = 0. Consider 
any two points r~(r~) and r + (r + ) (t~<t'<t + ) on ad¬ 
jacent arcs such that r~=rf and the complete segment 
r'y r y{r)> 0 for any t£(t~ ,t + ). Denote as At the mini¬ 
mal duration of free evolution (u=0) required to reach r + 
starting from r~. Then, At>t + —t~ . 


Since u anz (T) is locally optimal by assumption it is 
sufficient to consider the variations of the 5u(t ) which 
do not involve the vicinities of the trajectory endpoints. 
Moreover, it is sufficient to analyze the variations 5u(t) 
which are nonzero only in vicinities points where f(r)=0. 
To show this consider the McShane variation in the ar¬ 
bitrary interior point Ag of the bang arc (see Fig. 10 1 . 
Consider the piece A^AgAgAiO of the varied trajectory 
r'(r). According to Proposition [3] (see eq. ©) the path 
BgBgAg is more time-efficient than BgA^Ag if the varied 
segment A%Ag is sufficiently small. Thus, the trajectory 
AiB^BgAiO is more time-efficient than original segment 
AtA s A 9 AiO. By repeated application of the same rea¬ 
soning to the modified pieces of trajectory one can replace 
the control u'(t) with the more effective strategy which 
differs from u(t ) only in vicinities of the points r' with 
r' x — > 0 . Since it is sufficient to consider only this modified 
control policy we will rename it as v! (r) and will refer as 
the initial variation in the subsequent analysis. 

The characteristic piece AgA 2 A 3 Ag of the resultant 
trajectory is shown i n Fi g. [l0| Following the proof of 
Proposition[l] (see eq. (A2|) the path C 0 A 2 Ci is less time- 
efficient than CqAiBiCi. This implies that the path 
A\BiC\ is more time-efficient than A\A 2 C \. Accord¬ 
ing to Lemma [I] the path A 2 C\A 3 is more time-efficient 
than the path A 2 A 3 associated with the free evolution. 
As a result, the trajectory segment A\A 2 A 3 of the r'(r) 
is less time efficient than the combination of the segment 
A\BiC\ of the trajectory r"(r) with the segment C\A 3 . 
By continuing the similar analysis one finally comes to 
conclusion that the part of trajectory r'(r) between the 
points Ag and Ag is less time efficient than the corre¬ 
sponding segment of u" (r). Applying the same reasoning 
to the entire trajectory r'(r) we will reduce the original 
variation to the °II type control u"(t ) and trajectory 
r"(r). Note that we must assume that all the singular 
segments where u"{t)= 0 are located on the same side 
with respect to xz plane (otherwise the control time can 
be further reduced by eliminating some singular segments 
following the proof of Proposition [2j see eq. <©)• This 
mean, that all the interior bang sections of the control 
u"{t) are of length rmr/cos(a) (m £ N). Thus, the tra¬ 
jectory u"(t)= 0 must belong to the family T^\T\(u" anz [t)) 
with the same index k as ■7-'[k](it /,anz (r)) and the an- 
zatz zi ,,anz (r) related to u anz (r) via infinitesimal varia¬ 
tion. Since u anz (r) is time-optimal the performances and 
control times associated with policies u" anz and u anz are 
related as J“ z >J" anz and f ,anz <T" anz . Consequently, 
J>J" and T<T" , so that the control policies u"(t) and 
u'(t) can not be more effective than u(r). The latter 


conclusion completes the proof of Proposition [5] 

Proof of the Lemma Q} For concreteness, consider the 
case ^>0, r“> 0. Denote <5r=r + (r + )—r + (r + )— At. Us¬ 
ing simple geometrical considerations one can find that 


S T (r x ,r' z )=- Y 


arcsm 


s=±l 


sr'z—r x cot (a) 


1 —r x 


, esc (a.) — sr' cos(cO \ \ 

arCSm l A, /2 I 

yl —r' z A sin {ot) 


-\/tan 2 (a)+l 


(Dl) 




By differentiating (Dll we find that 


£7 Sr(r x ,r z =0)=- (a 2 _ 1 ) ( c J ( 2 a)+ 2 z 2 _ 1) <° for any 
admissible r“>0. Similarly, one can show that 
<5r(r“=0, r z )=0 and r z -£j-Sr(rf ,r ' z )<0 for any ad¬ 
missible r' z ^0. Taken together, these relations lead to 
conclusion that Sr(rf ,r z )< 0 for any admissible r“>0 
which completes the proof for the case r' y > 0 , r~> 0 . 
Other cases can be analyzed in the same way. □ 


Appendix E: Proof of Proposition [6] and [7] 


One can directly check that the transformation 
S±= exp(Ar£(±u max )) is equivalent to the composition 
of rotation S?. (=f£) around axis e z by angle with ro¬ 
tation iS,^ ± , un| x ( 77 ) around the normal vector n±u max to 
the plane A±„ max by rp. 


S±=Sn ±1 (ii)S?ATO (—tt< 77<0; 0<£<7r), (El) 


where the domain restrictions on the values of p and £ 
result from ©. Thus, the state transformation induced 
by any two subsequent bang arcs is equivalent to rota¬ 
tion around n±„ max by angle 2rj. This proofs that the all 
odd (even) corner points are situated in the same plane 
orthogonal to n u - ( n u + ) and parallel to e 2 . More specif¬ 
ically, they are located on the circles rn± ttmax =co which 
are mirror images of each other in xz plane. 

In order to complete proof of Proposition [ 6 ] it remains 
to show that e z £\± Umllx (i.e. that co=0). Since it is al¬ 
ready shown that Fz||A± Umax it is enough to prove that 
there exist an least one common point with axis e z . Con¬ 
sider the infinitesimal variations 6t~ and 5t+ of the du¬ 
rations Ar^ and Ar^ + i of the bang arcs adjacent to ar¬ 
bitrary corner point fi=f(fi ), such that the transforma¬ 
tion S= exp(5r~C(u~)) exp(5r^ moves the point 
fi into r[£ A~ r . In other words, we require that fi and 
r[ should relate by infinitesimal rotation S, j__ (dyf). For 


convenience, we will call such variations as ’’sliding” ones. 
The form of decomposition (El) indicates that the sliding 
variation at zy shifts the locations of all subsequent cor¬ 
ner points rj>i^-r'j by similar rotations Sa _ (S'ji) around 


3 
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the associated axes n -. Consider the arbitrary compo¬ 
sition of the sliding variations, such that the trajectory 
start and end points remain fixed, i.e. ]Tb 67 ^= 0 . If the 
extremal u is locally optimal then such variations should 
not allow the reduction of the control time T: <5iy<0, 

where <5 t,; = S r 7 " + 5 . This requirement leads to the fol¬ 
lowing first-order (in diy) necessary optimality condition: 


w. . . dSji __ dS^j 
’ ^ dSri dSrj 


(E2) 


Using simple geometrical analysis it is possible to explic¬ 
itly calculate the derivatives in (E2): 


dSji _ 2^/cos 2 (§)+<« 

d5n sin (I) - V l +<^ cos (f) 


(E3) 


We can conclude that equalities (E2) are equivalent to 
condition: r ~'" [ m" =const which directly leads to conclu- 

r i,y b 

sion that e z £\±\ and completes the proof of Proposi¬ 
tion [ 6 l 


Remark 1. It is worth stressing that the above proof 
of Proposition [ 6 ] does not explicitly depend on the time 
optimality of the trajectory u(t). Thus, its statement 
is generally valid for any type I extremal locally optimal 
with respect to small variations of control u{t), including 
the case of fixed control time T. 

The proof of Proposition [7] follows from the analysis 
of the higher-order terms in sliding variation along the 
extremal trajectory. Calculations result in the following 
expression: 


Appendix F: Proof of Proposition [9] 


Let q'=qi>< 0 be the smallest term in the set {qi}- By 
applying Proposition [7] to the corner points adjacent to 
t'-tli we have: qi'±±+qi><0. These inequalities can be 
rewritten after some algebra as: 




arccos ^sin 2 (cos( 77 ) + 2 )^ ; 

+ cos " 1 (FI) 

where dqi'=( 7 i' mod n) — % (| _ One can 

show that at least one of the inequalities (FI) holds if 


|jj|< arccos(v / 2— 1)- From the definition of 77 it follows 

that the latter inequality holds for any u max >\/1+\/2. 
This means that for this range of controls the *'-th 
corner point can be only either the left-most or the 
right-most corner point of time-optimal extremal. Us¬ 
ing Fig. m one can accordingly improve the estimate for 
+2 <2 for u max ^\/1+\/2 Q.E.D. 




r< 


bl 

7T-|l7| 


Appendix G: Proof of Proposition |10| 


Suppose that fy is interior corner point of the glob¬ 
ally time-optimal solution. From (23) it follows that 

sin(C*) sin(f )occsin(Ci). where c is some real 


constant. Since | sin(^/)|< sin(^|^) and |Ci ,— 
the following inequality holds 


<57i=2 cos(|) Ay- 


sin 3 (f) 


qM? +qf' ) &Tf +o(Ar 3 ), 


(E4) 


where 



6 cot( 7 ») (tan +(*+!) tan 3 


(E5) 


The necessary condition of the local optimality is thus 
the inequality Y^i =1 —0 in which the variations <5r,; 

are subject to constraint 0- The power of slid¬ 

ing variation is in the fact that the quadratic form in the 
left-hand side of this inequality is diagonal (i.e. the con¬ 
tributions of the sliding variations dji are independent 
up to the second order in 1 Ay). Thus, optimality implies 
non-negativity of the following simple quadratic form: 


Qkj=Skjqk+q n {k,j=l,...,n-l), (E 6 ) 

which can be easily rewritten in the form of statement of 
Proposition [7J 


T'i',x ?V±l,x 


>0. 


(Gl) 


Proposition [7] states that the trajectory curve in vicin¬ 
ity of ry ;X should be A-shaped (U-shaped) in the case 
of ry . x <0 (ry, x >0), as shown in Fig flT] Together with 
(Gl) this means that both left and right adjacent arcs 


intersect the plane x=fi^ x twice and have the second 
common point {ry,®, —ry^, fy,*}. However, the globally 
time optimal trajectories can not have intersections with 
themselves. This contradiction proves the statement of 
Proposition. The associated maximal number of switch¬ 
ings can be directly deduced using Fig. [5] 


Appendix H: Proof of Proposition |11| 


The statement of Proposition will be proven by con¬ 


tradiction. Suppose that the first of inequalities (24) 


is violated (the case of violation of the second in¬ 
equality can be treated similarly), i.e. 3 i : (Vj : 

U,x<T 7 >Arj )X < 0 ) . Using Proposition|3]we conclude that 
U+i,x and that the trajectory around iy is 
A-shaped: 3e, \/6tG(— e, e) : f x (' 7 +(>T)<f x ('y). Similarly 
to the proof of Proposition |T0| these observations mean 
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FIG. 11. Projection of the extremal in vicinity of the corner 
point fy on xz -plane in the case fi\ x < 0. Orange dashed 
ellipse is the projection of intersection of the Bloch sphere 
with the planes A±i. Arrows indicates the admissible routes 
of passing the point ?y according to Proposition [3] 


that the both arcs T(z(fj_i,fj) and re(fj, fi+i) should 
cross the plane x=f/ jX twice and thus have the common 
point {fi tX ,— However, the latter contradicts 

with the assumed global time optimality of the trajec¬ 
tory r(r). 


Appendix I: Proof of Proposition [l2| 


Similarly to r + and r ~, let us introduce the new nota¬ 
tions r± = ri ~^ r " ±sign(|fi |X | — |f n|X |) ri for the first and 
the last corner points fi and r n of trajectory f(r), so that 
I ^ 1^— jX |. Using Fig. E we find that: 

C+ - C- , , i arcsin (r + x <j>)- arcsin(r_ x <j))\ 

n l= - + 1=1 - 1 ----- ! -|+ 1 , 

7 r + r] 2 arctan(u max (/)) 

(ii) 


where 



Eq. (|TT]) can be rewritten as: 


n\= 


r+,: 




d(j) 


J?( 


0 ' 1+tig 


i)d<t> 


-+ 1 . 


( 12 ) 


The integrands in the numerator and denominator of ( |]~2| ) 
are monotonically increasing and decreasing functions of 


(f> in the range of interest. Since sin(|)>|f+ jX | one obtains 
the upper estimate ni<ni imax , where: 


arccos(U-^) 

' "T ) x 


ni. 


: h+,xi 2 arctan(prj lfl2 j) 


+ 1 . 


(13) 


In order to make this result constructive we need es¬ 
timates for r± iX . Elementary analysis shows that 
f-,x) is a monotonic function of r_ jX and 
reaches a maximum when sign(r +ja; )f_ ja; is minimal. At 
the same time, ni imax (f+ iX , r_. x ) is a concave function 
of f .|- >x when f+, x f_ iX <0 and monotonically increasing 
function of |f +jX | in the range 7~+ iX r_ iX >0. Thus, the up¬ 
per estimate for ni imax can be calculated by substituting 
into ( [Pi] ) appropriate upper and/or lower estimates for 
f +jX and r_ jX . Specifically, according to Proposition 11 
|r_ jX |<|f +jX |<|f+|, and 0<]rU x |<|r“|. Substitution of 
these estimates results in (25a) for the case f+f“<0 and 


the second of the estimates (25b) for the case rjf x >0. 


rt f x 

■ 


Note that the latter estimate directly accounts for 
the location of only one trajectory endpoint and can 
be further refined. Namely, due to (24) the corner 
points in the case r + x f_ iX >0 are located in the range 
rve[0,f+]. Since the ^-coordinates of the corner points 
are monotonic functions of the index i (see Proposition |10| 
and Fig. [5]), the trajectory can be split into two con¬ 
tinuous parts R\ and R 2 such that all n^ (jir 2 ) cor¬ 
ner points in the segment i?i(l? 2 ) belong to the range 
ri,x£(r~,r+] (fi iX =[0, f ~]), and their junction point r c is 
chosen such that r c>x =r“. Using these range estimates 
and the extremal properties of function we obtain 

arccos(^jy) 

that n Rl < | 2arctail ( j5jraic.)| + 1 - Let us show that n R2 <3 


(which will prove the first estimate in (25b)). Indeed, 
the duration A tr 2 of this segment can not exceed 7r (the 
maximal duration of the trajectory with m(t)=0 connect¬ 
ing f~ and f c ). At the same time, according to eq. (19) 
the minimal duration of each arc of the bang-bang trajec¬ 
tory is cos a. Thus, the number of the interior bang seg¬ 
ments of duration At in the case ri m ax<l can not exceed 
[2V2]=2, i.e. tir 2 < 3 (the same restriction for the case 
Umax> 1 trivially follows from Proposition ([8])). Hence, 
Proposition is completely proven. 
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